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ABSTRACT 


This report investigates relationships between observers, Kalman Filters and dynamic 
compensators using feedforward control theory. In particular, the relationship, if any, 
between the dynamic compensator state and linear functions of a discrete plant state 
are investigated. It is shown that, in steady state, a dynamic compensator driven by 
the plant output can be expressed as the sum of two terms. The first term is a linear 
combination of the plant state. The second term depends on plant and measurement noise, 
and the plant control. Thus, the state of the dynamic compensator can be expressed as 
an estimator of the first term with additive error given by the second term. Conditions 
under which a dynamic compensator is a Kalman filter are presented, and reduced-order 
optimal estimators are investigated. 
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I. INTRODUCTION 


In Appendix A of Reference 1, relationships were developed between dynamic com- 
pensators and observers. A basic question answered in Appendix A of Reference 1 is 

• When is a dynamic compensator an observer of a linear function of plant states? 

In this short report, the following more general question will be answered: 

• What is the relationship between a dynamic compensator and the corresponding plant 
dynamics? 

The dynamic compensator may or may not be an observer of plant states. This question 
is resolved using the theory of feedforward control developed in Reference 2. After the 
general question is answered, the solution is used to determine optimal Kalman filters and 
reduced-order optimal stochastic observers. 


II. FIRST REPRESENTATION 
A compensator of any chosen order may be represented as 

0Lc,k+ 1 = Z c ,k "b tL c ,k "b y^k (l) 

The compensator state vector is z ck , the compensator control vector is u ck and u k is 
the plant control vector. The compensator is related to the plant by choosing u c , the 
compensator control, as follows 


±c tk = y k 


( 2 ) 


The plant is represented as 


x k+1 =(t>x k + Tu k +T w w k (3) 

y k = Cx k +v k (4) 

The state vector is x k , the control vector is u k , as previously mentioned, and the white noise 
disturbance is w k . The measurements are t/ fc . The white noise measurement disturbance 
vector is v k . 

Using Reference 2 as a guide, the following equation is posed as the relationship 
between the plant and the compensator, 


f *ck \ = ( s ii Si 2 Si 3 
\U C)k ) \S 2 1 S 2 2 S 2 3 



f - k \ 

“Jfc+1 

—k+2 



V : J 


+ 


(B 12 
\B 22 


B\z 

B 2 z 



-^23 



f —k \ 

™ k +l 

m+2 

: y 


( 5 ) 


The assumption about the relationship between the plant and compensator in Equation 5 
becomes valid if all the unknown matrices in Equation 5 can be uniquely determined. 
Substituting Equation 2 into Equation 5 yields, 


Sn = C (6) 

$22 — ^23 — • • • == 0 (7) 

A. 2 2 — A 23 = • . . = 0 ( 8 ) 
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B 22 = I 


( 9 ) 


B23 = B33 = . . . = 0 


( 10 ) 


From Equation 1, the following is true 


= r.] (^‘)+ r „u t 


From Equation 5, the following occurs 


c,k+l - Zc,k — [£ll(^ — I) Si\T — 5i2 S \2 — S\z 


+ [^11 Tu, — A\2 A\2~A 


13 


' (“•■) 


( V-k 

V-k+i 


( 11 ) 


/ ** \ 

Hjfc+l 

V i J 


(12) 


Equating Equation 11 and Equation 12, results in the following algebraic relationships, 




— I) ^iiT — 5j 2 — T u 5x2 — 5x3 

“ V c 0 0 




(13) 


[(*<- r > r ‘) ("o 12 A “ :::) = ( 


^xxTu, — j4x2 -4x2 — A\z 
0 0 


;;;) (u) 


k*. - j) rj ( B ; 2 B 0 13 ; j = ( B ; 


B\2 B\2 — B\z 
0 


:::) 


(15) 
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From Equation 13, the Sn matrix satisfies the Lyapunov equation 


<t>cS 11 +S ll {-<f>) = -T c C (16) 

the other S matrices are obtained as 


<t>c S 12 = s u r-r u 

(17) 

4>c SlZ = <S'l2 

(18) 

<f>c <S'l4 = $13 

(19) 

From Equation 14, the A matrices are obtained as 


<Pc -^12 — Sll Tu, 

(20) 

<i>c Aiz = A\2 

(21) 

From Equation 15, the B matrices are obtained as 


<£c B \2 = — r c 

(22) 

<£c B\z = B\2 

(23) 


Using techniques developed in Reference 2, further simplifications of the relationships 
are possible. The compensator matrix, <f > c , is assumed to be invertible. Substituting the 
solution of the S, A, and B matrices back into Equation 5, and expressing Equation 5 in 
the z domain produces, 
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Z.C — [^11 {I + <f>7 iz + fa* 2 * + ' • •) ^ 12 ] 

+ [I + <f>c l Z + <f>~ 2 Z 2 + . . .] A12 W 

+ [^ + 4>7 lz + ^r 2 * 2 + •• •] Buy. (24) 

z^, the compensator state, and the z-domain variable, z, in Equation 24 should not be 
confused. It is easily shown that 

{l-z<j>~ 1 ) -1 = I + <t>- l z + <f>~ 2 z 2 + ... (25) 

hence, define 


x k = (I - z<f> c *) 1 [5i2U + yli 2 t£ + B 12 u] (26) 

Converting Equation 26 back to the time domain and using Equations 17, 20 and 22, the 
first important result is obtained, 


Zc,k = Snx k + x k (27) 

x k+1 = ~ (Sn r — r u )u* — 5n T w w k + r c u fc (28) 

From Equation 28, it can be concluded that if the noise sources are zero, if <£ c is stable 
and if, 


r„ = 5 u r (29) 

then the dynamic compensator is an observer and Su determines what states in x fc , 
observes, i.e., 
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Ic.fc = Snx k (30) 

If Equation 29 is not satisfied, then the dynamic compensator state observes the plant 
states plus an additional signal, x k , caused by the plant controls. 

The white noise assumption for w k and v k is not used in the derivation. The variables 
w k and v k show how any type of disturbance, i.e., biases, white noise, colored noise, etc., 
alter the dynamic compensator operation. It is rare in implementation that r« can be 
chosen to equal 5nT exactly. Equations 27 and 28 are potentially useful in evaluating 
observer sensitivity to plant variations. 

In the next section, the compensator structure is altered and rederived. The objective 
is to yield a Kalman filter implementation. 


m. SECOND REPRESENTATION-KALMAN FILTER APPROACH 


The derivation in Section II is altered by assuming Equation 4 changes to 


»«.* = St+i < 31 > 

The dynamic compensator is now using the most recent measurement of y to influence z c . 
Equations 6 to 10 change to 


S 2 i = C<j> 


(32) 


s 22 = cr 


(33) 


S23 — S24 — ... — 0 


(34) 
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The other changes are 
(Equation 16) 

(Equation 17) 

(Equation 20) 

(Equation 22) 


A 22 — O T w (35) 

-A 23 = A 24 = . . . = 0 (36) 

B 22 = 0 (37) 

B 23 = I (38) 

B24 ~ B25 — • • • = 0 (39) 


<f>c &U + Sn(—<j>) — —T e C <J> (40) 


<t> c S12 = S\\Y — T u — T c CT 


(41) 


<t> c A \2 


•Sii Tu, T c CT 


w 


(42) 


B 12 = 0 


(43) 
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(Equation 23) 


4 >c B 13 = — r c 


(44) 


<f>c £14 = B\z 

The expression for z ^ ^ in Equation 26 changes to 


(45) 


Zc,k = Snx k + x k 


(46) 


Ijc+i tfrciiLk [(^n c)r r u ] u k 

(^ii r c CjTu, Wj^ + T c (47) 

In a Kalman filter formulation, the matrix Sn should be the identity matrix and u k 
should not affect the estimate. If these constraints are placed on Equation 46, Equation 
40 changes to 


4>c = [I-T e C)4 (48) 

T u is chosen to eliminate u k in x k in Equation 47, yielding 

r u = (i-r c c)r (49) 

Substituting Equations 48 and 49 into Equation 3, yields, 

2 c ,jk+i = ^5c,fc + r«j k + r c (j/ fc+1 -c(^2 C)fc + ru fc )^ (50) 

Equation 50 is immediately recognizable as the update expression in a Kalman filter if T c 
is a Kalman filter gain. 
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Substituting Equations 48 and 49 into Equations 46 and 47, yields, 


z c ,fc = x k + x k (51) 

1 = — r*c c)<f> x k (/ — r c c)T w w k + r c v k + j (52) 

where x k is the steady state noise corrupting signal to the estimate. The compensator gain 
r c is the only unknown in Equations 51 and 52. 

Clearly the objective of the compensator is to reduce the error term, x k , in Equation 
51. The next section constructs an optimization problem for minimizing x k . 


IV. OPTIMAL SOLUTIONS FOR COMPENSATOR 
DYNAMICS — THE KALMAN FILTER 


One of the most important features of the results in Section III is that the compen- 
sator state is decomposed into a component related to the plant states and a component 
resulting from the noise sources in the plant and measurements. If there are elements in 
the compensator that are unknown, then one approach for choosing the unknown elements 
is to minimize the compensator state component caused by the noise sources. 

As an example, consider the case discussed in Chapter III which resulted in a Kalman 
Filter structure. Equations 51 and 52 are 

lc,k = x. k + x k (53) 

5jt+i = (I — r c C)4>x k — (I — T c C)T w rv k + T c (54) 
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where r c , the compensator gain, is an unspecified matrix. Assume that T c is to be chosen 
to minimize the error, x k , in steady state, i.e., 

J^E[xlQx k ) (55) 

The cost function can be rewritten as 


J = tr{<? P } (56) 

where 

P = E{x k xl) (57) 

P is the estimation error covariance in steady state. The steady-state estimation error 
covariance can be computed using Equation 54 to obtain, 


p = (i - T e c)<j>p <t> T {i - c T if) + (/ - r c c)w(i - c T if ) + r c v if ( 58 ) 

W is the covariance of the process noise, T w yi k , and V is the covariance of the measurement 
noise, v k . If the right hand side of Equation 58 is substituted into J and dJ/dT c is 
computed then, 

0 = = r c {c<j>p<t> T c T + cwc T + v)-<f>p<f> T c T -wc T (59) 

dr c 

Defining 


P(-) = < t>P<f> T + W 


(60) 


Then, T c is given by 


T c = P(-) C T [CP{~) C T + V] -1 


(61) 


10 


The expression for T c in Equation 61 is recognized as the steady-state optimal Kalman 
filter gain. P (— ) in Equation 60, is the covariance of the error extrapolation as discussed 
in Reference 3. 

It should be clear from the previous example that minimizing x k causes the compen- 
sator to behave as an optimal estimator. The next objective of this report is to compute 
reduced-order optimal estimators. The next section derives the optimal (n — £) compensator 
that optimally observes the n — t plant states not measured in C. 

V. REDUCED-ORDER OPTIMAL ESTIMATORS 


For reasons that will become clear later, the reduced-order optimal estimator is best 
designed assuming the following structure 

£c,fc + 1 =^cic,lc + r 1 y j , + 1 +r 2 y jt + r u tt t (62) 

The relationship between the plant and the model in Equation 62 using the theory of 
feedforward control is 


— c ,/c — Sll Xk 


(63) 


x-k+i — ((*^n c)r r u ) Uk 

— {Sii — Fi C)T w w_ k + Ti Vfc +1 + T 2 v k 


(64) 


4>C ^li + ^li (— ■ 4>) — — T2 C-TiC* 
Assume the plant states have been rearranged so that 


(65) 
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y 

p 


c i c 2 
o 


C j ) £ (66) 

and Ci is an £ x £ invertible matrix. The rearrangement can always be done if C is of full 
rank. Using the following transformation matrix to rearrange the plant states, 


-(? °!) ■■ -r c -) 


(67 a,b) 


results in the plant representation 


(St;) = (£i ^)(^) + (^) fik+r “ ,iau (68a) 


su = l' °] 


V* 

l£*j 


+ y 


y.k 


(68 b) 


The objective is to find the optimal compensator which estimates only the (n — £) p states 
using only the y measurements. 

Consider applying the transformation 


T x = £ 


n — t 


£ n- £ 
I 0 
L I 


(69) 


to the plant. The matrix L is unknown. Multiplying the left side of Equation 68 by T x in 
Equation 69 produces, 


( 


I 0 
L I 


y k+ i = 

Ek+J 


An 


^12 


A 2i + LAn A%2 + LA\2 


Zk 

.Pk 


The following equation for p occurs as the lower partition in Equation 70, 


(70) 


P k+l = {A 22 + LA 12 ) p k — Ly k+1 + (A 21 + LAn) y k + ( B 2 + LB 1 ) u k + T w3 w k (71) 
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The dynamic relationship for p in Equation 71 is the equation which will be used for the 
compensator dynamics with the noise sources in Equation 71 eliminated. The need for 
y fc+1 and in the compensator equation is evident when Equation 71 is compared with 
Equation 62. The objective is to find the matrix L which minimizes x where 

Zc,k+i — (-^22 + LAu) k - Ly k+1 + (An + LAu)y k + (B 2 + LB\) u k (72) 
Comparing Equation 72 with Equation 62, the solution for Sn is 

[A„ + £A 1J ]S Il +S 1I (“^j °l(xl! ill) 

— [An + L Au][I 0] (73) 

It is easily shown, by direct substitution, that 

i (n-t) 

Sn = £{0 I ] (74) 

satisfies Equation 73. The matrix Sn indicates that z c k , using the structure in Equation 
72, will observe p k as desired. The transformation matrix in Equation 69 is used in 
Reference 4 to construct the (n — £) reduced order observer. It can be shown that if ( C , A) 
is an observable pair then (An, An) is an observable pair. Observability guarantees that 
there exists a gain L which stabilizes the system (An, A 22 ). 

From Equation 64, with T u chosen to eliminate u k , i.e., T u = B 2 +LBi, the estimation 
error dynamic equation reduces to 


x k+ i — (.A 22 + ■£'■^ 12 ) ~ \L I) TwOLk ~ ■£'!’*+ 1 + (-4.21 + LAn) y k (75) 

Constructing the steady-state cost function yields, 

J = E {xl Q i k ) = tr{Q P) (76) 
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where 


^ = E{x t xf} (77) 

P is the steady state estimation error covariance. The optimal solution for the observer 
gain, L, which minimizes the cost function in Equation 77 when measurement noise cor- 
rupts the output, yjt, can be shown to be the solution of a cubic matrix equation. In this 
report, we will restrict attention to the case where the plant output contains no measure- 
ment noise. Using Equation 75, the steady state estimation error covariance satisfies the 
equation, 

W 

, s 

P = (A 2l + L An) P (A?, + Af, L T ) + [/£]( ^ ) ( [ T ) (78) 

Substituting the right side of Equation 78 into Equation 76 and constructing dJ/dL, 
results in 


0 = — = L{A 12 P + W 3 ] + [ A 22 p A\ 2 + ^ 2 ] (79) 

The solution for L is 

L = -\A 2i P A T l2 + W 2 ][A l2 P A? 2 + W 3]" 1 (80) 

The numerical solution for P and L can be obtained using Equations 78 and 80 and the 
approach in the next section. Note that the Q weighting matrix does not affect the L gain 
matrix. 
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VI. OPTIMAL ESTIMATORS OF ARBITRARY ORDER 


This section will describe a method for obtaining an optimal estimator of arbitrary 
order. Consider the plant shown in Equation 68. Assume the states have been reordered 
so that those states not measured in y for which estimates are required are partitioned as 
the states p in the following, 

— A 


( y.k+i A ( M\ A ™\ ( y.k\ ( Bi \ 

Ei,k+i = M21 M2 A 2Z P l>k I + [Si u k + T w 4 Wj' ( 81 ) 

V&.fc+l/ V ^31 Mi M3J \P 2 ,kJ V B 3 J 

The objective is to cause the dynamic compensator to optimally estimate only the p 
states. Applying the following transformation to the plant 


T = 



yields the following equation for p 

—A 


( 82 ) 


P 2) k+i “ (^33 + BAl3 )Ei,k ~ Ly_k+i + (-^31 + LAu)y k 

+ (B3 + LBi)u k + + (A32 + LAn) p lk ( 83 ) 

A dynamic compensator can be constructed which observes p if a matrix L can be 

—A 

found which stabilizes (A33 + LAiz) and causes (A32 + L A\ 2 ) to be a zero matrix. 

The following cost function strives to achieve both objectives 

J = E Qi x* j + -tr {(A32 + LA 12 ) Qi (A32 + LAi 2 ) t } ( 84 ) 

If L does not stabilize the compensator, then the estimation error, x k , would not be stable 
and J would not be finite. Increasing the Q 2 weighting matrix causes L to minimize 
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A.32 + LA12. The dynamic compensator is an observer of p only if A32 + LA i2 is zero. 

— 2, Ac 

The form of the compensator is 


Zc,k+i — (-^33 + L j4i3)£c,fc — Ly k+l + (^4 31 + L .An) y fc + (B 3 + LB X ) u k (85) 
The solution for Su is 

[A33 + L Ai 3 ]Sh + Su(—<p) = L\I 0 0] <f) — [A. 31 + LA\i)\I 0 0] (86) 

If A 32 + LA 12 is not a zero matrix, then Equation 86 must be solved to determine exactly 
what combination of p 1 and p 2 the compensator state actually observes. The covariance 
equation for the estimation error without measurement noise is 


P=(X 33 + i/l 13 )P(A|'3 + Af3L 3 ')-(S 11 +£[/ 0 0])H'(S, T 1 + 



L t ) 


(87) 


In order to minimize Equation 84, the equality constraints in Equations 86 and 87 are 
introduced into J using Lagrange multipliers, 


J — tr {Qi P} + -tr {(>132 + LA 12 ) Q 2 {A 32 + LA X 2 ) t } 

+ {[.A33 + LA13] Sn — Su 4 > — L[I 0 0] <f> + \A3i + LAu][I 0 0]} X T 


+ {—P + (^33 + LA13 ) P (aJ 3 + A x3 l t ) 


- {Sn + L[I 0 0])W(5 1 t 1 + 




( 88 ) 


The X and Y matrices tire the Lagrange multipliers. The necessary conditions for a 
minimum for J are as follows: 



dJ 


= [A& + A T l3 L t \ X - X 4? + Y Sn W 


(90) 


0 = 


ds 
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0 = % = L(A 12 Q 2 Af 2 ) + 2 Y L[A 13 P A? 3 + W x \ + A 32 Q 2 Af 9 
oL 


+ XS? 1 Af 3 -X<j> T 
+ 2 Y -A33 P A^f 3 



(91) 


An algorithm to solve for L based on the algorithm in Reference 5 would proceed as follows: 
Choose an L which stabilizes A33 + L A\ 3 = <i> c . 

Choose a scalar a for which the following converges: 

1. Solve for Sn in Equation 86. 

2. Solve for Y in Equation 89. 

3. Solve for X in Equation 90. 

4. Solve for P in Equation 87. 

5. Solve for L ne w in Equation 91. 

6. Choose L k +i = L k + oc(L nevi - L k )- 

7. Check for convergence. If L k +\ destabilizes the plant, reduce a until L k + 1 stabilizes 
the plant. If convergence is not obtained, go to Step 1 and repeat. 

Equation 91 has the following form 

LA + BLC = D (92) 

If either A ox B and C are invertible, Equation 92 can be rewritten as 


L = ALB + C 


(93) 


17 


and solved using readily available algorithms for solving general Lyapunov equations. If 
A and B and C are not invertible, then L in Equation 92 can be solved using Kroneker 
products. 


VII. SUMMARY 


The important contributions of this report are Equations 46 and 47 and Equations 
63 and 64. Given a dynamic compensator of any order and a plant, these equations show 
how the compensator state is related to the plant states, controls, and noise sources. The 
conditions which cause the dynamic compensator to revert to an observer or Kalman filter 
are readily identified from the relationships in the equations. Optimal stochastic observers 
are developed by minimizing the estimation error identified in Equations 47 and 64. 
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